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^ (54) Title: METHOD AND APPARATUS FOR OBTAINING MEASUREMENT DATA FOR PERFORMANCE ANALYSIS IN 
\d A RADIO NETWORK 

m 

(57) Abstract: A method and apparatus for obtaining relevant measurement data for analysis of radio network (10) performance. 
— Measurement data (M1-M4) from difTcrcnt network entities (E1-E4) is collected and saved regularly (100). As each saved batch 

^ of data is shorter than the total time, temporal accuracy is improved as the time window for when an event could have occurred is 
shortened. Data processing starts by finding (102) all entities (E2-E4) (usually cells (C1-C4) that potentially interface with the entity 
(El) being analysed. The entities (E1-E4) are then classified (104) according to link usage. The measurement data (M1-M4) is 
filtered (106) lo obtain only those records that correspond to a certain network (lO)trafTic scenario. The output data (108) is suitable 

^ for statistical calculations are performed (108) to obtain the results of the analysis. 
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METHOD AND APPARATUS FOR OBTAINING MEASUREMENT DATA 
FOR PERFORMANCE ANALYSIS IN A RADIO NETWORK 

BACKGROUND OF THE INVENTION 

5 Technical Field of the Invention 

The present invention relates to radio networks and, more specifically to an 
apparatus and a method for obtaining measurement data for performance analysis in 
such networks. 

10 Description of the Related Art 

Operators of radio networks, and specifically mobile radio networks 
(hereinafter used as an example), have an interest in providing the best possible service 
with the available equipment. One way of improving service is to ensure good 
transmission properties . by minimising interference and hardware problems, 

1 5 maximising coverage and so on. 

In order to be able to improve the network, relevant measurement data must 
be collected before any analysis can be performed. 

A common method is to rely on the experience and intuition of the technicians 
performing the analysis to come up with possible improvements. The solutions are 

20 then tested in order to provide feedback. Obviously, this way of working, while 
sometimes quite successful, suffers from drawbacks. Very experienced personnel are 
needed, which increases costs if such staff are available at all. The reliance upon 
'feelings' is not quantifiable, leading to poor information for decision making, for 
instance about whether or not new equipment should be bought. Furthermore, the trial- 

25 and-error approach may be time and resource consuming leading to an increase in 
costs for the network operator and, ultimately, the customers. 

More scientific methods try to identify interference sources based on 
correlation between events, such as for example correlating the utilisation of a first 
channel in a first cell in the network with the interference in a second channel in a 

30 second, potentially interfering cell. If the correlation between utilisation and 
interference is strong, that is a good indication that the source of the interference is the 
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first channel. A drawback with this method is that, as this method only takes into 
account measurement data from two cells at a time, it may lead to false identification 
of interference sources. In addition, not all systems are able to provide time stamped 
data. 

5 Yet another method tries to correlate interference with voice channel seizure 

events. Drawbacks with this method are that, as it uses event-event correlation, it takes 
a relatively long time to perform the calculations, and that there is an increase in 
processor load in the switch collecting the measurements. In addition, not all systems 
are able to provide time stamped data. 

10 As with most statistical methods, the reliability and usefulness increase with 

an increase in the amount and the quality of the data. A person with ordinary skill in 
the art will appreciate that this poses a problem for methods not using time stamps, as 
. the accuracy in time diminishes if data is collected over a long time period. For 
example, if data is collected over a 24 hour period, there is a distinct possibility that 

15 valuable data has been recorded, but that, without time stamps, it is impossible to 
know when, during these 24 hours, the interesting phenomena occurred. 

Based on the foregoing, it can be readily appreciated that there is a need for a 
simple, efficient solution to the problems of how to obtain relevant measurement data 
for the analysis of radio network performance problems. The present invention 

20 provides a solution to this problem. 

SUIN1MARY OF THE INVENTION 

In one aspect, the present invention is directed to a method and an apparatus 
for increasing the temporal accuracy of measurement data. 

In another aspect, the present invention is directed to several embodiments of 
25 a method and an apparatus for obtaining relevant measurement data for the analysis 
of radio network performance. 

Brief Description of the Drawings 

For a more detailed understanding of the invention, for further objects and 
advantages thereof, reference can now be made to the following description, taken in 
30 conjunction with the accompanying drawings, in which: 
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Figure 1 shows a block diagram illustrating a traffic scenario in a mobile radio 
network; 

Figure 2 shows a block diagram illustrating another traffic scenario in a mobile 
radio network; 

Figure 3 shows a kind of flow chart illustrating processing of data according 
to the method; 

Figure 4 illustrates how the obtained relevant measurement data can be used 
to analyse network performance problems; and 

Figure 5 shows a block diagram illustrating an apparatus for analysing network 
performance problems. 

Detailed Description of the Preferred Embodiments 

In order to facilitate understanding of analysis of radio network performance 
problems two network traffic scenarios will initially be given. 

FIG. 1 illustratesamobileradionetworktrafficscenario.FourcellsCl-C4that 
potentially interfere with each other are shown in mobile radio network 10. Each cell, 
C1-C4, comprises a base station 12, 22, 32 and 42 respectively. A number of mobile 
stations are located in the cells C1-C4, represented by one mobile station 11, 21, 31 
and 41 in each cell C1-C4. In the traffic scenario shown in the figure, cells C3 and C4 
are idle. In this and the following example this means that there is no communication 
going on between the base station 32 and 42, and the mobile stations 31 and 41 
respectively - in reality this would be applicable to each of the different channels in 
a cell. In cell C2 the mobile station 21 communicates with the base station 22; that is 
the cell is busy. Regardless of whether or not cell CI is idle or busy, with the right 
equipment it is possible to measure the influence of the traffic in cell C2 on cell CI. 
This will be discussed further on. 

FIG. 2 illustrates another mobile radio network traffic scenario, similar to the 
scenario illustrated in FIG. 1. The cells, C1-C4, the base stations 12, 22, 32 and 42, 
and the mobile stations 11,21,31 and 41 are the same as in FIG. 1. hi this scenario, 
however, none of the cells C2-C4 is busy, which means that for instance coverage 
problems, problems with the equipment in cell CI and external interference, i.e. 
interference originating from outside the mobile radio network 10, can be measured 
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and analysed. 

Now that it is clear what kind of analyses can be made and in what kind of 
network traffic scenarios it works, it is time to describe the collection of the data that 
makes said analyses possible. 
5 There are many interesting parameters that can be measured in a mobile radio 

network for subsequent performance analysis. These parameters are for example signal 
strength when the channel is busy (Busy SS) and when it is idle (Idle SS), and the Bit 
Error Rate (BER) on the uplink as well as the downlink. Some of these parameters, the 
uplink parameters, are measured by the base station equipment, while others, the 

1 0 downlink parameters are measured by the mobile station. 

As discussed earlier, measurement data without time stamps do not provide 
important temporal information, for instance, for analysing network performance. A 
solution to this problem is to take measurements and to save regularly the 
measurement data amassed in a relatively short time interval. An example will clarify: 

1 5 supposing that measurement data is to be collected for two hours, the standard way of 

doing this would be to collect data during those two hours and to store them all in one 
file. To increase temporal accuracy, however, measurement data will still be collected 
during the same two hours, but measurement data collected during a pre-set shorter 
time interval, say 1 0 minutes, will be stored separately. This will create 12 files for the 

20 two-hour period and it will be possible to know, to within 10 minutes at most, when 
the recorded events in each file occurred. Hence the temporal accuracy of the 
measurement data will be improved. In addition, it will be easier to detect various 
occurrences in the network, as data tend to smear together if collected over an 
extended period of time. 

25 Collecting data as described above can be done in two ways. If possible, the 

measurement program itself can run once and produce the twelve files. On the other 
hand, if the measurement program can only produce one file at the end of the 
measurement, then the measurement program will have to be run twelve times. Both 
ways produce essentially the same results, with a possible difference that the second 

30 way may miss some data when stopping and restarting the measurement program. 

It should be understood that the optimal division of a time interval into shorter 
time intervals depends on the circumstances, for example the rate with which 
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measurement data is recorded, the length of the measurement period, the expected 
changes in the scenarios and the duration of an "interesting" event. What is important 
for the later analysis is that the measurement data has good temporal accuracy and that 
corresponding measurements are collected at the same time. 
5 With the measurement data at hand, it is now necessaiy to obtain relevant data 

for subsequent analysis of network performance. FIG. 3 is a block diagram illustrating 
processing of data according to the method. A number of exchanges (MSCs) El, E2, 
E3, E4, that, among other things, collect measurement data are shown symbolically 
next to the measurement data Ml, M2, M3, M4, collected by the exchanges. The 

1 0 measurement data is collected from various entities comprised in that exchange, where 
an entity for example could be a cell, a channel, a device or a frequency band. In this 
case there are four exchanges and four corresponding sets of data; in reality there 
could very well be one set of measurement data for each exchange in the network. The 
measurement data Ml, M2, M3 and M4 respectively are collected, either directly in 

15 real time or retrieved from some computer readable medium, in step 100, and the 
measurement data for the entity to be analysed is obtained. The measurement data are 
made up of several different periods of measurement, ranging from 1 to N. The 
measurement data from a first period of measurement at exchange El is denoted Mil, 
the data form the second period Ml 2 and so on. The different periods making up the 

20 measurement data Ml, M2, M3, M4, are often continuous as well as disjunct in time 
but this is no absolute requirement. Nor is there any requirement as to the number of 
periods - with some luck, interesting results could arise from a single period - but as 
the method is statistical, it usually improves with the amount of data, at least up to a 
certain degree. The measurement data Ml, M2, M3, M4, from the different exchanges 

25 El, E2, E3, E4, should be collected at the same time, however. 

With the measurement data Ml , M2, M3, M4, at hand, it is time to filter it, step 
102, to obtain data for all the entities that are "potentially interfering" with the 
analysed entity. This could be done for a single entity or for several entities at the 
same time. In this case potentially interfering means that they reasonably can be 

30 expected to affect the analysed entity. In a mobile radio network, this will usually be 
entities with or using the same frequency or channel as the analysed entity (co-channel 
entities) as well as entities with or using a neighbouring frequency or channel 
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(adjacent-channel entities). Assume, in this case, that all of the entities corresponding 
to the exchanges E1-E4 potentially interfere with each other. Normally, the filtering 
would be on measurement data originating from cells, both co-channel and adjacent 
channel, understood that the measurements could be made on an entity within that cell. 
5 At this stage, it is also advantageous to classify the entities (or cells) as co-channel or 
adjacent-channel with regard to each analysed entity. In addition, the number of 
potentially interfering entities can be recorded. 

The next step, 1 04, is to classify the entities (again usually the cells) according 
to usage. The utilisation of both the uplink and the downlink channels are calculated, 

1 0 advantageously as a percentage. At this stage, or later, each channel could be classified 
as "Idle", i.e. the utilisation is below a certain threshold value, or "Busy", i.e. 
utilisation above another certain threshold value. It should be understood that "Idle" 
and "Busy" are not absolutes; for instance, a utilisation of 10% is not, strictly 
speaking, the same as totally idle, but for the purposes of the analysis it could very 

1 5 well be close enough to idle to have a minimal, or at least acceptable, influence on the 

analysis. In addition, it is possible to have further classifications, for example "Almost 
idle", "Rather busy" and so on. 

After having classified the cells according to usage it is necessary to filter the 
measurement data further, possibly by first selecting a sub-set of the measurement data 

20 and then by selecting only those instances that fit a certain traffic scenario; step 106. 

From a user point of view, i.e. someone working with radio network 
performance optimisation or improvement using a software tool comprising the 
present invention, it might be advantageous to select a sub-set of the measurement 
data. This is due to the fact that the user is not always interested in considering all the 

25 measurement data, but might be content with, for instance, only the data from a 
specific exchange. There are many different options to filter with regard to, for 
example: 

A specific system or group of systems 
A specific exchange or group of exchanges 
30 A specific cell or group of cells 

A specific frequency or group of frequencies 
Specific times or time periods 
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One or more specific potentially interfering cells 
Utilisation of specific links 

Above-mentioned filtering could of course be performed almost anytime as 
long as it occurs before the subsequent statistical calculations. 
5 Whether or not a sub-set of the data was selected above, filtering with regard 

to specific traffic patterns is now necessary. This filtering is necessary in order to 
obtain measurement data with the proper characteristics for later analysis, for instance 
by filtering according to the utilisation of the radio links associated with the relevant 
entities. An example, referring again to FIG. 1, is to sort out all the measurement 

1 0 periods for which an entity in cell CI is either Idle or Busy, while at the same time the 
entity in cell C2 is Busy, and the entities in cells C3 and C4 are Idle. Another 
possibility is to sort on the instances where all co-channel cells are idle. See the 
descriptions of FIG. 1 and FIG. 2 above for further explanations. 

If more than one instance fit the filtering profiles so far, two general options 

15 are available. The first option is to add all of said measurement data into a 

conglomerate, while the second option is to treat each batch of suitable measurement 
data individually, with the possibility to combine the results into one, single result 
later. 

The properly filtered measurement data is the output, 108, needed to perform 
20 the statistical calculations. Many different calculations are then possible; the following 
list gives some examples: 

Finding the amount of uplink or downlink interference caused by one of the 
interfering cells. 

Finding potential external uplink or downlink interference or hardware/device 
25 problems. 

Finding the amount of uplink or downlink BER caused by one of the 

interfering cells. 
Finding potential uplink or downlink coverage problems. 
An example of statistical calculations will now follow. A common way of 
30 measuring interference is to measure Idle Signal Strength, i.e. the signal strength that 
can be measured although there is no communication in a particular cell for a specific 
channel. As there is no communication in the cell itself, all of the signal strength must 
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come from other sources, e.g. co-channel cells. With the suitable measurement data 
- filtered as described above - it is possible to calculate a percentile, say the 90% 
percentile. This will show what value the Idle Signal Strength was lower than (or equal 
to) 90% of the time. This value can be used for many things, one use is to save the 
5 values to see if the interference increases or decreases over time. 

Another example of what the value can be used for will further explain the 
utility measurement data processed according to the method; see Figure 4. In this 
figure, seven cells are shown: a central cell C41, surrounded by six co-channel cells, 
C42-C47. In order to see if any of the co-channel cells C42-C47 interfere with the 

10 central cell C41, the method as described above can be used iteratively. First, 
measurement data for the central cell C41 and for all other cells is collected, 100. The 
utilisation of all the links is computed, 1 04, and the measurement data is filtered twice, 
106; first, if measurement data has been collected for more than the seven mentioned 
cells C41-C47, to obtain only the measurement data for the co-channel cells C42-C47. 

15 A second, iterative filtering will obtain all the measurement data for which the central 
cell C41 was Idle and for which, in turn, one of the co-channel cells C42-C47 was 
Busy, while the rest were Idle. The statistical calculation to obtain the percentile is 
performed for each of those six cases. Statistically, the highest value will be associated 
with the cell that interferes the most with the central cell C41. 

20 In the description above, only one entity is analysed, but it should be 

understood that the analysis could be performed for all the entities at the same time if 
desired. 

Figure 5 shows a block diagram illustrating an apparatus for processing 
measurement data to obtain relevant measurement data for analysis of network 

25 performance problems. The apparatus 50 comprises means for collecting measurement 
data 52, either directly or by reading files containing measurement data. Three filters 
54-56 are used for obtaining measurement data for the entity that is to be analysed 
(filter 54), obtaining measurement data for potentially interfering entities (filter 55) 
and filtering measurement data with respect to a sub-set of the measurement data and 

30 specific network traffic patterns (filter 56). A processor 58 computes the utilisation of 

radio links. Another (or possibly the same) processor 59, although not part of the 
invention as such, that calculates statistically at least one result to the specific radio 
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network performance question posed, can also be incorporated. 

Although several preferred embodiments of the method and system of the 
present invention have been illustrated in the accompanying Drawings and described 
in the foregoing Detailed Description, it will be understood that the invention is not 
5 limited to the embodiments disclosed, but is capable of numerous rearrangements, 
modifications and substitutions without departing from the spirit of the invention as 
set forth and defined by the following claims. 
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What is claimed is: 

1 .A method for obtaining relevant measurement data for the analysis of radio network 
(10) performance comprising the steps of: 
5 • collecting (1 00) measurement data; 

• obtaining the measurement data for a first entity, that is to be analysed; 

• obtaining (102) the measurement data for a number of entities that 
potentially interfere with said first entity; 

• computing (104) the utilisation of all radio links associated with the 
10 entities obtained above; and 

• filtering (106) all of the measurement data with respect to specific 
traffic patterns. 

2.The method according to claim 1, where at least part of the measurement data (Ml- 
1 5 M4) is retrieved from files recorded on one or several computer readable mediums. 

3 .The method according to claim 1, where at least part of the measurement data (Ml- 
M4) is collected in real-time. 

20 4.The method according to claim 1 , where the potentially interfering entities comprise 
any entity that at least partly uses the same frequency band as the entity that is 
analysed. 

5. The method according to claim 4, where the potentially interfering entities comprise 
25 any entity that uses the same channel as the entity that is analysed. 

6The method according to claim 1, where the potentially interfering entities comprise 
any entity that uses an adjacent radio channel relative to the analysed entity. 



30 



7. The method according to claim 1, where an entity could be a cell (C1-C4) in a 
mobile radio network (10). 
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8. The method according to claim 1, where an entity could be a frequency band in a 
mobile radio network (10). 

9. The method according to claim 1, where an entity could be a channel in a mobile 
radio network (10). 

10. The method according to claim 1 9 where an entity could be a device in a mobile 
radio network (10). 

11. The method according to claim 1, where the number of entities that potentially 
interfere with said first entity includes all potentially interfering entities for which 
measurement data (M2-M4) has been recorded. 

12. The method according to claim 1, where a traffic pattern is determined according 
to the utilisation of the radio links associated with the relevant entities. 

1 3 .An apparatus (50) for obtaining relevant measurement data for the analysis of radio 
network performance comprising: 

1. a device (52) for collecting measurement data for a specific time 
period; 

2. a first filter (54) for obtaining the measurement data for a first entity, 
that is to be analysed; 

3. a second filter (55) for obtaining the measurement data for a number 
of entities that potentially interfere with said first entity; 

4. a processor (58) for computing the utilisation of all radio links 
associated with the entities obtained above; and 

5. a third filter (56) for filtering all of above-mentioned measurement data 
with respect to specific traffic patterns. 



30 



14. A method of increasing the temporal accuracy of measurement data lacking time 
stamps by dividing the time during which the measurements are to be recorded into 
at least two time intervals during which the measurements are made. 
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15. The method according to claim 14 further characterised in that the above- 
mentioned time intervals are disjunct in time. 

16. The method according to claim 14 further characterised in that the above- 
5 mentioned time intervals together cover the entire time during which the 

measurements are made. 



17. The method according to claim 14 further characterised in that the measurements 
during a certain time period are recorded in a file on a computer readable medium. 

10 

18. The method according to claim 17 further characterised in that the above- 
mentioned file in addition is provided with at least one time stamp. 

19. The method according to claim 18 further characterised in that the above- 
1 5 mentioned time stamp is the time when the file was saved provided by the computer. 

20. The method according to claim 18 further characterised in that the time stamp 
records the time when the measurements started. 

20 21. The method according to claim 18 further characterised in that the time stamp 
records the time when the measurements ended. 

22. The method according to claim 18 further characterised in that there are two. time 
stamps that record the times when the measurements started and ended, respectively. 



25 
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(57) Abstract: A method and apparatus 
for obtaining relevant measurement 
data for analysis of radio network 
(10) performance. Measurement data 
(M1-M4) from different network entities 
(E1-E4) is collected and saved regularly 
(100). As each saved batch of data is 
shorter than the total time, temporal 
accuracy is improved as the time window 
for when an event could have occurred 
is shortened. Data processing starts by 
finding (102) all entities (E2-E4) (usually 
cells (C1-C4) that potentially interface 
with the entity (El) being analysed. 
The entities (E1-E4) are then classified 
(104) according to link usage. The 
measurement data (M1-M4) is filtered 
(106) to obtain only those records that 
correspond to a certain network (lO)traffic 
scenario. The output data (108) is suitable 
for statistical calculations are performed 
(108) to obtain the results of the analysis. 
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